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Abstract 

Let / be a probability density and C be an interval on which / is bounded away from 
zero. By establishing the limiting distribution of the uniform error of the kernel estimates /„ of 
/, Bickel and Rosenblatt (1973) provide confidence bands _B„ for / on C with asymptotic level 
1 — a e]0, 1[. Each of the confidence intervals whose union gives Bn has an asymptotic level equal 
to one; pointwise moderate deviations principles allow to prove that all these intervals share the 
same logarithmic asymptotic level. Now, as soon as both pointwise and uniform moderate 
deviations principles for /„ exist, they share the same asymptotics. Taking this observation 
as a starting point, we present a new approach for the construction of confidence bands for /, 
based on the use of moderate deviations principles. The advantages of this approach are the 
following: (i) it enables to construct confidence bands, which have the same width (or even a 
smaller width) as the confidence bands provided by Bickel and Rosenblatt (1973), but which 
have a better aymptotic level; (ii) any confidence band constructed in that way shares the same 
logarithmic asymptotic level as all the confidence intervals, which make up this confidence band; 
(iii) it allows to deal with all the dimensions in the same way; (iv) it enables to sort out the 
problem of providing confidence bands for / on compact sets on which / vanishes (or on all . 
by introducing a truncating operation. 



Key words and phrases: Density; Kernel estimator; Asymptotic logarithmic level; Asymptotic 
almost sure confidence regions; Moderate deviations principles. 
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1 Introduction 



Let Xi, . . . , Xri be independent and identically distributed M"^- valued random variables with bounded 
probability density function /. The problem of computing confidence bands for / is of central in- 
terest in nonpar ametric statistics. 

One main known approach to the construction of confidence bands for / is due to Bickel and 
Rosenblatt (1973) in the case d = 1 and to Rosenblatt (1976) in the case d > 2, and is based 
on the limiting distribution of the normalized uniform error of the kernel density estimate. The 
approach of Bickel and Rosenblatt has been extended, in the unidimensional case, in several direc- 
tions; among others, let us cite Mack (1982) and Liu and Ryzin (1986) for the extension to other 
types of density estimates, Burke and Horvath (1984) and Mielniczuk (1987) for the censored data 
case, Xu and Martinsek (1995), Martinsek and Xu (1996), Sun and Zhou (1998) for the construction 
of sequential confidence bands, and Gine, Koltchinskii and Sakhanenko (2003, 2004) for different 
asymptotics of the weighted uniform error. Another common technique for constructing confidence 
bands is through the bootstrap, which is in particular used for bias estimation; see, for example. 
Hall (1992) for the density and Hardle and Marron (1991) for the regression. For other approaches, 
see Hall and Titterington (1988) and Hah and Owen (1993). 

Our object in this paper is to present a new approach, based on the use of Moderate Deviations 
Principles (MDP) of the normalized uniform error of the kernel density estimates. We avoid bias 
estimation by a slight undcrsmoothing, which is shown in Hall (1992) to be more efficient than 
explicit bias correction when the goal is to minimize the coverage error of the confidence band. 

The use of large and moderate deviations in statistical inference is not new. It has been initiated 
by the papers of Chernoff (1952) and Bahadur (1960), and then dcvelopped in various directions. 
Let us cite, among many others, Borovkov and Mogulski (1992), Groeneboom (1980), Ibragimov 
and Radavicius (1981), Kallenberg (1982, 1983a, 1983b), Korostelev and Leonov (1995), Nikitin 
(1995), Mokkadem and Pelletier (2005), and Puhalskh and Spokoiny (1998). 

The idea of using MDP for the construction of confidence bands for / comes naturally when 
making a pointwise analysis of the confidence bands provided by Bickel and Rosenblatt (1973). 
Consider the univariate framework (that is, the case d = 1), and let C be a bounded interval of M 
on which / is assumed to be bounded away from zero. Let /„ denote the kernel estimator of /; 
Bickel and Rosenblatt (1973) establish the asymptotic law of sup^.^^ \fn{x) — fix) \ / f{x) suitably 
normalized. This result allows them to provide sequences of random intervals In{x) for all x G C, 
which satisfy the property: 

\im^¥{3x e C, f{x) ^ In{x)) = a. 
For simplicity, we also denote by In{x) the segment {x} x In{x), and say that 

is a confidence band for / on C with asymptotic level 1 — a G]0, 1[. In other words, the set of 
functions 

Dn,a = {g:R^R, g{x) G In{x) Vx G C} 

is a confidence region of / with asymptotic level 1 — a. (Although Dn,a is a confidence region of the 
functional parameter / since lim„^oo P (/ G Dn,a) = 1 — a, it gives nontrivial confidence intervals 
of the values f{x) only for x e C). 

Now, a straightforward application of the central limit theorem (CLT) allows to prove that 
the asymptotic level of each confidence interval In{x) {x G C) whose union gives Bn,a, is one. A 
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natural question is then to wonder at what rate the levels of the intervals In{x) go to one. A result 
giving the convergence rate to zero of the sequence P(/(x) In{x)) is typically a MDP result; this 
convergence rate is thus expected to be exponential. That is the reason why we introduce here 
the notion of logarithmic asymptotic level for confidence regions of (eventually infinite dimensional) 
unknown parameters. 

Definition 1 Let {-Dn} be a sequence of confidence regions of an unknown parameter 0. The 
logarithmic asymptotic level of {D^} is j ('y > 0) with speed (w^ oo) if 

lim — logP(6l ^ Dn) = -7. 

Of course, if {-Dn} has a logarithmic asymptotic level 7 > 0, then the asymptotic level of {Dn} is 
necessarily one. 

It turns out that the sequences of confidence regions, which have a positive logarithmic asymp- 
totic level, are often asymptotic almost sure sequences of confidence regions in the sense of the 
following definition. 

Definition 2 Let {Dn} be a sequence of confidence regions of an unknown parameter 6, and let O 
denote the underlying probability space. {Dn} is an asymptotic almost sure (or consistent) sequence 
of confidence regions of 9 if there exists Q,q (ZVt such that: 

• P(J^o) = l 

• Vo; e Ho, ^N{(jj) such that n > N{uj) =^ 9 e Dn{uj). 

Indeed, the following proposition is a straightforward consequence of Borel and Cantelli Lemma. 

Proposition 1 Let {Dn} be a sequence of confidence regions of an unknown parameter 9, whose 
logarithmic asymptotic level is 7 > with speed Wn — > 00. // there exists 6 G]0,7[ such that 
X) exp(— Jwn) < 00, then {Dn} is an asymptotic almost sure sequence of confidence regions of 9. 

Let us come back to the pointwise analysis of the confidence bands provided by Bickcl and 
Rosenblatt (1973). Later on, we shall prove in particular that, for all x G C, the intervals Ln{x) 
have a logarithmic asymptotic level 1 with speed log(l//i„), where /i„ is the bandwidth used for 
the computation of the kernel estimator /„. So, the confidence bands -Bn,a with asymptotic level 
1 — a < 1 provided by Bickcl and Rosenblatt arc unions of confidence intervals /„,(.t) whose asymp- 
totic levels equal one and whose logarithmic asymptotic levels arc independent on the value of x G C. 

The difference between the asymptotic level of the confidence band Bn,a on the one hand and the 
asymptotic levels of all the confidence intervals In{x) on the other hand is explained by the difference 
between the asymptotic weak behaviour of the uniform error of the kernel density estimator (given 
by Bickel and Rosenblatt's result) on the one hand and the asymptotic weak behaviour of the 
pointwise error of the kernel density estimator (given by the central limit theorem) on the other 
hand. Now, MDP for the nonnormalized error of the kernel density estimator have been established 
by Gao (2003) (see also Mokkadem, Pelletier and Worms (2005)); it turns out that, as soon as both 
pointwise and uniform MDP exist, the pointwise and the uniform MDP share exactly the same 
asymptotics. Taking this remark as a starting point, we propose, in this paper, a new approach to 
construct confidence bands for / based on the use of MDP for the normalized error of the kernel 
density estimator. This approach has several advantages: 
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• It allows to construct confidence bands S*, which have the same width (or even a smaller 
width) as the confidence bands i?n,a provided by Bickel and Rosenblatt (1973), but which: (i) 
have an asymptotic level equal to one instead of 1 — a g]0, 1[; (ii) share the same logarithmic 
asymptotic level as all the confidence intervals whose union gives S*; (iii) are asymptotic 
almost sure confidence bands. 

• In order to deal with the multivariate framework, Rosenblatt (1976) has to require the use of 
higher order kernels and, consequently, to impose rather stringent conditions on /; in contrast, 

in the MDP approach, all the dimensions are dealt with in the same way, and thus without 
any additional assumption neither on the density, nor on the kernel, in the case d> 2. 

• Whatever the dimension d is, Bickel and Rosenblatt require the condition "/ is bounded 
away from zero on C" . On the contrary, our approach enables us to sort out the problem of 
providing confidence bands for / on compact sets on which / vanishes. As a matter of fact, we 
introduce a truncating operation, which modifies the width of our confidence bands at some 
points X € C, but which does not affect the logarithmic asymptotic level of our confidence 
bands. This truncating operation also enables us to provide confidence bands for / on all 
W^. Let us mention that, in the case d = 1, Gine, Koltchinskii and Sakhanenko (2003, 2004) 
propose a slight modification of Bickel and Rosenblatt's normalization of the uniform error; 
this allows them to construct confidence bands on the whole line in the case / does not vanish 
on M. 

Our paper is now organized as follows. In Section 2, we explicit the construction of our confi- 
dence bands. Section 3 is devoted to the precise statement of our assumptions and main results. In 
Section 4, we discuss particular examples of applications of our main results: we first come back on 
the pointwise analysis of the confidence bands provided by Bickel and Rosenblatt (1973), and show 
how the MDP approach allows to construct more suitable confidence bands; then, we consider the 
problem of constructing confidence bands with smaller width. Section 5 is reserved to the proofs. 

2 Construction of confidence bands based on the use of MDP 

Let C be a subset of R*^ and (w„) be a positive nonrandom sequence that goes to infinity. In this 
section, we construct confidence bands for f on C with width of order v~^. We first consider the 
case C is a compact set on which / is bounded away from zero, and then introduce a truncating 
operation, which allows to consider the general framework (/ may vanish on C, C may equal M'^). 

2.1 Confidence bands on compact sets on which / is bounded away from zero 

Let C be a compact set of M.'^ on which / is bounded away from zero. To construct a confidence 
band for f on C with width of order v~^, we first construct, for all x G C, confidence intervals of 
f{x) with width of the same order. For that purpose, we proceed as follows. 

• We estimate f{x) by using the kernel estimator 



where the bandwidth (/i* ) is a sequence of positive real numbers such that lim^^oo h"^ = 0, 
limn-^oonh^ = oo, and where the kernel if is a bounded nonnegative function satisfying 
Jgd K{z) dz = l and lim||^||_<^ K{z) = 0. 




(1) 
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The variance of fn{x) is equivalent (as n goes to infinity) to (nh^) where k = 

/jjd K'^{x)dx; we estimate it by (n/i*'^)~^/„,(x)K, where /„ is the kernel estimator of / defined 

by 



fn{x) 



1 



n j=i 



(2) 



the bandwidth being eventually different from (/ijj). 
The confidence intervals for f{x) (x G C) are then defined as 



In{x) 



(3) 



where (5 > 0. 



Our confidence band for / on C is finally defined by setting: 

Bn = U^^cLix). (4) 

In Section we give conditions on the sequence (vn) and the bandwidths and {h'^), which 
ensure that the logarithmic asymptotic level of each interval Inix), x € C, on the one hand, and of 
the confidence band i?„ on the other hand, is 5^/2 with speed nh*jf /v'^ (see Theorems ^ and • 



2.2 Truncating operation 

In order to allow the construction of confidence bands for / on subsets C of K"' (eventually equal 
to W^) on which / may take the value zero, we now introduce a truncating method, which relies 
on the following fact. For the values of a; G C for which fn{x) is "large enough", the width of the 
intervals In{x) defined in © is suitable; but, for the values of x £ C for which fn{x) is zero, or, 
more generally, "close to zero" , the width of the intervals In{x) is clearly not appropriate any more. 
In order to compensate for this problem which appears for "small" values of fn{x), we impose a 
minimum width to all the confidence intervals whose union gives the confidence band for / on C; 
of course, this minimum width does not affect the width of the confidence band at the points x £ C 
for which fn{x) is "large enough". 

More precisely, we introduce a sequence (e^) of positive real numbers satisfying lim„^oo = 0, 
and define the truncating function T„ by setting 

f(^\ ^ i fn{x) if fn{x) > en, 

1 Cn otherwise. 

For each x G C, we set 



in{x) = 

and finally define Bn as 

Bn = U^^cLix). (7) 

In Section 13.31 we give conditions on (e^), which ensure that the logarithmic asymptotic level of 
the confidence band Bn is 5^/2 with speed nh^/Vn (see Theorem 01 in the case C is a compact 
set, and Theorem |1] in the case C = W^). In other words, the logarithmic asymptotic level of the 



\/fn(x)K \/Tn(x)K 



(6) 
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confidence band i?„ defined in @ is not affected by the introduction of this truncating method. 

Prom a practical point of view, it seems more realistic to take the width of the largest confidence 
interval into account in the truncating operation, that is, to introduce the quantity sup^-.g^- (x) 
in the definition of the truncating function. For that purpose, let the sequence (e„) satisfy the 
additional condition < 1 for all n, and define the function T„ by setting 

I e„[sup^gt7/„(x)] otherwise. 

In Section 13.31 we establish that when the parameter Tn{x) is replaced by Tn{x) in the intervals 
In{x), the logarithmic asymptotic level of the confidence band remains unchanged (see Corollary 
^in the case C is a compact set, and Corollary [2 in the case C = R'^). 

3 Assumptions and Main Results 
3.1 Assumptions 

Before stating our assumptions, let us first define the covering number condition. Let Q be a 
probability on M.'^ and J- C C2{Q) be a class of Q-integrable functions. The covering number (see 
Pollard (1984)) is the smallest value N2{e, Q, J-) of m for which there exist m functions gi, ■ ■ ■ ,gm S 
J~-2{Q) such that 

min ||/-5i|l£2{Q) < e V/ € 

(if no such m exists, N2{e,Q,T) = oo). Now, let A be a bounded and integrable function on R*^, 
and let J^(A) be the class of functions defined by 

X — z \ , „ _^ 



J^(A) = |z ^ A y—f^j > ^ > 0' X G R'^l . (9) 

A is said to satisfy the covering number condition if there exist A> Q and f > such that, for any 
probability Q on and any e g]0, 1[, 

iV2(e||A||oo,Q,.F(A)) < (^^) . (10) 

The classes which satisfy ()lUp are often called Vapnik-Chervonenkis classes. When d = 1, the real 
valued kernels with bounded variations satisfy the covering number condition (see Pollard (1984)). 
Some examples of multivariate kernels satisfying the covering number condition are the following : 

- the kernels defined as K{x) = '(/;(||x||), where V is a real valued function with bounded 
variations (see Nolan and Pollard (1987)). 

- the kernels defined as K{x) = nf=i (^i) where the Ki, 1 < i < d, are real valued functions 
with bounded variations (this follows from Lemma Al in Einmahl and Mason (2000)). 



We can now state our assumptions. 

Xi, . . . , Xn are i.i.d. R'^-valued random vectors with bounded probability density /. The kernel 
estimators and /* of / are defined in © and respectively, and the bandwidths (/i„) and (/i* ) 
are two sequences of positive real numbers such that 

hn ^ and h* 0. 
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The assumptions to which we wih refer in the sequel are the following. 
(Al) i^T is a bounded and nonnegative function on R'^ such that 

J^dK{z)dz = l, Jg^d ZjK{z)dz = 0\fj e {I, . . . ,d}, and J^^d \\zp\K{z)\dz < oo. 

{A2) K is Holder-continuous on M!^ and satisfies the covering number condition. 

(A3) / is twice differentiable on M^, sup^gjjd ||V/(x)|| < oo, and sup^g^d < oo. 

{A4) There exists g > such that z ^ ||z||'^/(z) is a bounded function on M"^. 

Let us recall the notation 

K'^{z)dz. 



3.2 Confidence regions without truncating 

Let {vn) be a sequence satisfying oo. The object of our first two theorems is to specify the 
logarithmic asymptotic level of the sequences of confidence intervals and of confidence bands defined 
in (jSJ and @ respectively. 

Theorem 1 Assume {Al) holds, set x G M'^ such that f{x) ^ 0, and assume that f is twice 
differentiable at x. Moreover, assume that (hn), {h'^) and (vn) satisfy the conditions 



nht 



oo, Vnh*^ — > 0, and 



Then, for any 6 > 0, we have 
„,2 / 



""n 



OO. 



logP f{x) 



Moreover, if the additional condition 



holds, then the sequence of intervals 



nh'^ 



vl\og{l/hl) 



oo 



rn{x) 



■Vfn{x)K 



Vfnix)K 



is an asymptotic almost sure sequence of confidence intervals of f{x). 



2 ' 



(11) 



Theorem 2 Let (Al) — {A3) hold and assume that f is bounded away from zero on a compact set 
C . Moreover, assume that {hn), {h^) and {vn) satisfy the conditions 



nh* 



oo, fn^ra^ 0, and 



vl log(l//i*) 
Then, for any 5 > Q, we have 

v"^ ( 
lim ^^logP 3x G C, f{x) 



"-n 



OO. 



(12) 



' 2 ' 
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Moreover, the sequence of sets of functions 



I)„ = <7 : - K, \9ix) - /:(x)| < J vx G C 

[ Vn 

is an asymptotic almost sure sequence of confidence regions of f. 



Comments on Theorems ^ and [21 

1) The regularity assumption on / in Theorem ^ is usuahy required to estabhsh a CLT for /^(x) 
in the case when /* is defined with a two-order kernel; the assumptions on / in Theorem [21 
are weaker than those required by Bickel and Rosenblatt (1973) to establish the asymptotic 
distribution of the normalized uniform error of the kernel density estimator. 

2) The condition Vnh'^ (together with the regularity assumption on /) ensures that the 
bias of /* does not interfer. In the case / is only once differentiable on M*^, this condition 
must be replaced by Vnh'^ for Theorems ^ and [21 hold. 

3) The main tool used to prove Theorem^is pointwise MDP established for the normalized error 
of the kernel density estimator, whereas the demonstration of Theorem [21 relies on the use of 
uniform MDP; that is the reason why the conditions ()12() in Theorem [21 are slightly stronger 
than the conditions of Theorem ^ Now, as soon as the conditions of Theorem [21 hold, 
pointwise and uniform MDP give exactly the same asymptotics. This unity in pointwise 
and uniform MDP differs from the gap there exists between the nature of the asymptotic 
distribution of the normalized pointwise error of the kernel density estimator (given by the 
CLT) on the one hand, and of the normalized uniform error of the kernel density estimator 
(given by Bickel and Rosenblatt (1973)) on the other hand. 



3.3 Confidence regions with truncating 

The next theorem allows to set up confidence bands for / on compact sets C on which / may take 
the value zero. Let the positive real-valued sequences (hn), (h^), (vn) and (e„) satisfy the following 
conditions 

hi 

0, ^^0, 

En 



0, ^ 



n 

en 



Vn.e. 



3/2 



oo, 



*2 



nh 



*d 



vi iog(i//i*; 



oo, 



J2ud 2 

h*J 



(13) 



oo. 



and let T„ be the function defined by ([SJ. 



Theorem 3 Let (Al) — {A3) hold, assume that there exists x € C such that f{x) ^ 0, and that 
the sequences {h^), {h^), (vn) o^n-d (en) satisfy il!^) . Then, the conclusions of Theorem\^ still hold 
when fnix) is replaced by Tn{x). 



Let Tn be the function defined by Q with e„ < 1 ; with the help of Theorem [31 we will prove 
the following result. 

Corollary 1 Let (Al) — {A3) hold, assume that there exists x £ C such that f{x) ^ 0, and that 
[hn), (^n), {vn), and (e„) satisfy Then, the conclusions of Theorem\^ still hold when fn{x) 

is replaced by Tn{x). 



7 



The extension of Theorem El and Corohary ^ to the case C = R'^ holds under the additional 
assumption {A4). 

Theorem 4 Let (Al) — {A4) hold, and assume (hn), (^n); (vn) (^nd (e„) satisfy Then, the 

conclusions of Theorem\^ still hold when fn{x) is replaced by Tn{x) and C by W^. 



Let Tn be defined by © with e„ < f and C = M''. 

Corollary 2 Let (Al) — {A4) hold, and assume {hn), {h^), (vn), and (e„) satisfy Then, the 

conclusions of Theorem\^ still hold when fn{x) is replaced by T„(x) and C by R°'. 



Remark Let us mention that Corollaries ^ and [21 also hold when the sequence (e^) is constant 
(en = e g]0, f] for all n); in the case en = 1, the width of the confidence bands does not depend on 
the point x G C. 



4 Particular cases 

In this section, we first give a pointwise analysis of the confidence bands provided by Bickel and 
Rosenblatt (1973), and show how the MDP approach allows to modify these confidence bands 
in order to obtain confidence bands whose width is of the same order as the one of Bickel and 
Rosenblatt's confidence bands, but whose asymptotic level equals one instead of 1 — a < 1; in 
particular, we explicit the choices of the parameters (/i* ) and (en), which give the best convergence 
rate to one of the level of these modified confidence bands. Then, we consider the problem of 
constructing confidence bands, which are thinner than those provided by Bickel and Rosenblatt, 
but whose level converges to one slower than the level of the modified Bickel and Rosenblatt's 
confidence bands does. We give two possible choices of (/i*), which both correspond to the case 
our confidence bands are centered at an optimal kernel estimator of /; for the first choice, the 
optimality is according to the criterion, and, for the second one, to the L°° criterion. 



4.1 On Bickel and Rosenblatt's confidence bands 

4.1.1 Pointwise analysis of Bickel and Rosenblatt's confidence bands 

Set d = 1 and let C = [ci,C2] be a bounded interval of M. Bickel and Rosenblatt (1973) con- 
struct confidence bands for f on C with asymptotic level 1 — a e]0, 1[ in the case when: {i) f is 
bounded away from zero on C; {ii) the kernel K is chosen absolutely continuous on M and such that 
J^K''^(t)dt / 0; (Hi) the bandwidth hn used for the computation of /„ is chosen equal to (n~°) 
with a s]^, Their confidence bands are constructed as follows. 

Set a g]0, 1[, Za such that exp(— 2 exp(— Zq,)) = 1 — a, and, for all x £ C, 

\/fnix)K 



In{x) 



fn{x) 



\/nhr, 



log(l//i„) (^V2 



V21og(l//ln), 



fn{x) + ^^^^^log{l/hn)(V2 + Un+ , . 

Vnhn ^ \ V21og(l//in) 



(14) 



with 



V2log{l/ hr. 



log 



27r' 



+ log 



C2 - Cl 
TT 



(15) 
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Bickel and Rosenblatt (1973) prove that 

is then a confidence band for / on C with asymptotic level 1 — a. A straightforward application of 
the CLT ensures that, for each x G C, the asymptotic level of In{x) equals one. Now, Theorem^al- 
lows to specify the convergence rate of the asymptotic level of the confidence intervals In{x) toward 
one. More precisely, the application of Theorem ^ with = (/i*) and (vn) = {\/nhn/ log(l//in)), 
together with a continuity argument, ensure that the logarithmic asymptotic level of each 
confidence interval In{x) is 1 with speed log(l//in)- 

The difference between the asymptotic level of the confidence band -Bn,a and the asymptotic lev- 
els of all the confidence intervals Inix) is explained by the difference between the asymptotic weak 
behaviour of the uniform error of /„ (given by Bickel and Rosenblatt's result) and the asymptotic 
weak behaviour of the pointwise error of fn (given by the central limit theorem). Adopting the MDP 
point of view, it is note-worthy that this phenomenon corresponds to the case pointwise MDP hold, 
but not uniform MDP. As a matter of fact, when d = 1, the sequence (vn) = {\/nhn/ log{l /hn)) 
fulfills the conditions (|1H) required by Theorem Q but not the slightly stronger conditions (|12j) 
imposed by Theorem |2 



4.1.2 Improvement of Bickel and Rosenblatt's confidence bands 

The aim of this section is to show how the MDP approach allows to improve the confidence bands 
provided by Bickel and Rosenblatt (1973). In a first part, we introduce a translation, which allows to 
provide confidence bands that have the same width as the confidence bands provided by Bickel and 
Rosenblatt, but which have a better asymptotic level. In a second part, we give a simplification of 
these translated confidence bands, which does affect neither their width order, nor their logarithmic 
asymptotic level. Then, we show how we can get rid of the condition / is bounded away from zero 
on C. Finally, we give the extension to the multivariate framework. 



Confidence bands translation We consider here Bickel and Rosenblatt's framework, that is, 
the case d = 1, C = [ci, C2], and / is bounded away from zero on C. 



n with a i[, let /„, u„ and Za be defined in the same way as in Section 



Set (hn) - yo , ...... ^ -J5> 2 

14.1.11 and (/i* ) be a bandwidth satisfying the conditions 



n"'h*^ 00 and 



logn 



0. 



(16) 



Moreover, let /* be the kernel estimator of / defined with the bandwidth /i* , and, for each x G C, 
set 



tnix) 



\/fn{x)K 



log(l//i„) (^V2 + Un + 



f*{x) + ^^^^V^log(l//i.) IV2 + Un + 



V21og(l//i„)^ 

V2log{l/hn)J 



Note that, for each x in C, /^(x) is the translation of the confidence interval Inix) (defined in (dJ) 
from the quantity /j^(x) — fn{x). 
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The application of Theorem ^ (with d = 1 and = {\/nhn/ log(l//i„))), together with a 
continuity argument, ensure that, for each x in C, the logarithmic asymptotic level of In{x) 
is equal to 1 with speed /i* log(l//i„)//i„. Let us underline that the speed obtained for 
is faster than the speed obtained for In{x); in other words, the levels of the translated intervals 
go to one faster than the levels of the intervals In{x)- This is explained by the fact that the 
translated intervals are centered at the point f^ix) rather than at the point fn{x), and, in 

view of the conditions ((TB|l . the estimator converges to f{x) faster than the estimator 

does. 



The application of Theorem [2 (together with a continuity argument) ensures that -B* is a con- 
fidence band for / on C whose logarithmic asymptotic level equals 1 with speed 



The confidence band i?*, which is just the translation of Bn^a from the quantity /* — /„, has 
thus the following advantages: 

• It has the same width, at each point x G C, as the confidence band provided by Bickel 
and Rosenblatt. 

• Its asymptotic level is one instead of being 1 — a < 1. 

• The logarithmic asymptotic level of i?* is the same as the logarithmic asymptotic levels of 
all the intervals /j^(x) whose union gives i?*, and the intervals /j^(x) themselves have a better 
logarithmic asymptotic level than the intervals In{x) whose union gives Bn^a- 

Let us mention that the advisable choice of the bandwidth (/i*) is (/i*) = (n~'-^~'^)/^), where 
a is the parameter which defines (/in)- As a matter of fact, among the sequences (/i*) = (n~*) 
which satisfy it is the choice that maximizes the speed /i* log(l//i„)//i„ (which then equals 
n(^"~^)/^ log n). Let us underline that the condition a > 1/5 implies (1 — a)/4 < 1/5. For this 
optimal choice of the bandwidth {h'^), the confidence band 5* (respectively the confidence interval 
/*(x)) is thus centered at an estimator /* (respectively fn{x)) whose convergence rate is given by the 
convergence rate of its bias term. Consequently, 5* (respectively /j^(x)) cannot be compared with a 
confidence band (respectively confidence interval) centered at /* (respectively fn{x)) and provided 
by Bickel and Rosenblatt's result (respectively by the central limit theorem). The surprising aspect 
of this result is that this optimal choice of (/i* ) depends on the choice of the bandwidth (/i„) and 
is never the choice for which the estimator /* converges at the optimal rate. 

Simplification of the translated confidence bands The parameters Un (which depends on 
the length of the interval C) and Za (which depends on the asymptotic level a), which appear in the 
definitions of the intervals Inix) and I^ix), play a crucial role in Bickel and Rosenblatt's approach. 
However, they do not have any effect in the MDP approach. That is the reason why we propose 
here a simplification of the definition of the confidence band i?*. More precisely, we set 



Now, set 



B*^ = U,ecl*n{x). 



h*Jog{i/K)/h 



where, for each x G C, 




rn{x) 



\/fn{x)K 



^log(l//in)^ ; /:(x) + 



Vfn{x)K 



y^log(l//i„)^/2 



\/nh- 
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A straightforward application of Theorems ^ and |21 ensures that the logarithmic asymptotic 
levels of In*{x) for all x G C and of B** equal 1 with speed /i* log(l//i„)//i„. In particular, 
we see that this simphfication does not affect the logarithmic asymptotic level. 

Confidence bands truncating Although the simplified confidence band B^* seems very con- 
venient to use, it suffers from the same drawback as the confidence band Bn^a proposed by Bickel 
and Rosenblatt (1973): its use is conditionned to the fact that the density / is bounded away from 
zero on C. In order to allow the construction of confidence bands for / on intervals C on which / 
may take the value zero, we now introduce the truncated confidence band defined as: 

where, for each x G C, 



irix) = ax) - ^ll^^\og{i/K)V2 ; ax) + ^ll^^\og{i/K)^ , 

Tn being the truncating function defined in (jHJ. A straightforward application of Corollary ^ (re- 
spectively of Corollary [JJ in the case C is a compact set (respectively in the case C = M) ensures 
that, if (e„) = (logn)~^ with e g]0, 1[, then the logarithmic asymptotic level of i?*** is 1 with 
speed h*^\og{l / hn) / hn- In other words, the truncating operation, which allows the construction 
of confidence bands for the density on compact sets on which / vanishes or on the whole line, does 
not affect the logarithmic asymptotic level. 

Let us underline that the advantage of truncating is not only to enable the construction of 
confidence bands for / on intervals on which / may take the value zero. Even in the case / is 
bounded away from zero on C, truncating gives, in practice, much better results as soon as the 
length of the interval C is large. 



The multivariate framework As mentionned in the introduction, the problem of constructing 
confidence bands when the probability density / is defined on R"' has been considered by Rosenblatt 
(1976). His approach consists in an extension to the d-dimensional case [d > 1) of the results ob- 
tained by Bickel and Rosenblatt (1973). However, in order to enable the construction of confidence 
bands for / on a compact set C on M"' (on which / is bounded away from zero), Rosenblatt (1976) 
requires the use of kernels of order k > d{d + 2)/2, and, consequently, imposes rather stringent 
conditions on /. On the opposite, with the MDP approach, all the dimensions are dealt with in 
the same way. More precisely, let the bandwidths (/i„) and (/i*) be defined as {hn) = (n~") with 



d+4 

d+4' (i(d+8) 



a G 



set, for each x G C, 



and (/i*^ 



n 



-{l-a(i)/4 



■■{x) 



f:ix) 



VTJxJk 



), the sequence (e^) as (e„) = (logn) ^ with e g]0, 1[, and 



y/Tn{x)K. 



log(l//i„)^ ; ax) + 



n 



hi 



log(l//i„)V2 



where the truncating function T„ is defined in (jHJ . A straightforward application of Corollary ^ 
(respectively of Corollary [21) in the case C is a compact set (respectively in the case C = R*^) 
ensures that, the logarithmic asymptotic level of the confidence band 5*** = Ua;gc'/*** (x) 
is 1 with speed h*f'log{l/hn)/h'^ . Let us mention that this implies the existence of two positive 
functions A^*" and A^^ which go to infinity with a logarithmic rate, and such that 



exp -^n(['^+4]'^-iW'^Ar(n) 



<P(3xgC, f{x)^i:**{x))<exp 



.^^([d+4]a-l)d/4;^+(^) 
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4.2 Thinner confidence bands 

The width order of the confidence band i?*** is (log n)-'^/^n^^ with 6 < 2/{d + 4); this width might 
seem too large, and thinner confidence bands might be prefered, although the convergence rate to 
1 of their asymptotic level is slower. 

The smallest possible width of confidence bands whose width does not depend on \/f{x) and 
whose asymptotic level equals 1 — a < 1 is, according to the minimax theory, M[(log n)/n]2/('^+4) 
where the constant M depends on some known bound of ||/||oo and ||/"||oo (see Ibragimov and 
Hasminskii (1981), Donoho and Liu (1991), Donoho (1994), and Tsybakov (2004)). This optimal 
width can not be reached in the case the width of the confidence bands depends on f{x); as a 
matter of fact, for a large class of densities (which includes the standard Gaussian density), the 
sequence [n/logn]^/('^+^)||(/„ — /)/\/7l|oo is known to be not stochastically bounded (see Gine and 
Guillou (2002), pp. 918). 

In this section, we give two examples of choices of the parameters (/i*), (fn), {hn)-, and (e„), 
which lead to confidence bands whose width order is close to [(logn)/n]^/('^"'"^). 

• Set (/i*) = (c*n^^/^'^~''^^) with c* > 0; this choice corresponds to the case the confidence 
bands provided by the MDP approach are centered at the kernel estimator, which minimizes 
the (integrated) mean squared error. For this choice of bandwidth, the sequence (f„) can be 
chosen as: 



J*- 

(logn)'^ / 



with V* > and a > — , 

2 



the sequence (/i„) can be chosen equal to (/i*) or to (c[n/logn] ^/('^+^)) with c > 0, and the 
sequence (£„) as: 

(en) = (e*(logn)"'') with e* > and e < 2a. 

The application of Corollary ^ (in the case C is a compact set) or of Corollary [21 (in the case 
C = M*^) ensures that the logarithmic asymptotic level of the confidence bands defined as 
Bn = Uxecln{x) with 



(17) 



is then equal to 5^/2 with speed nh^^/v^. Consequently, there exist two positive functions 
and A2 which go to infinity with a logarithmic rate, and such that 

^-§x-in) < p (32; g c, f{x) /„(x)) < n-^^^("). 

• Set (/i*) = (c*[n/logn]~"'^/*^°'"''^^) withe* > 0; this choice corresponds to the case the confidence 
bands are centered at the kernel estimator, which minimizes the uniform error. For this 
choice of bandwidth, we can construct confidence bands whose width is arbitrarily close to 
[(logn)/n]^/('^"'"^), by choosing the sequence (f„) as 





n 




logn 



2/ {(1+4) 



1 



with V* > and a > 0, 



(log log n)"- 

the sequence (/i„) equal to (/i*), and the sequence (e„) as 

(e„) = (e* (log log n)""") with e* > and e < 2a. 
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The apphcation of Coroharies ^ [21 ensures that logarithmic asymptotic level of the confi- 
dence bands defined as = Uxecln{x) with In{x) defined in ((T7|) is then equal to 5^/2 with 
speed nh'^/v'^. Accordingly, 

(logn)-^^3 < P(3x G C, fix) In{x)) < {logn)-^^t(^) 

where A3" and A3 are two positive functions, which go to infinity with a rate in log log. 

Let us finally mention that, in all the previous examples, the truncating function T„ can be 
replaced by the function T„ defined in © . 

5 Proofs 

We first give a unified proof for all the almost sure parts of our results in Section 15.11 Then, 
Theorem ^ is proved in Section 15.21 Theorems HI |31 and |2 in Section 15.31 and Corollaries H and [21 
in Section IK711 

5.1 Unified proof for all the almost sure parts of our results 

The proof relies on the use of both conditions 



— > and 



nh] 



*d 



vl log(l//i*) 



00. 



Set 7 = (5^/2, Wn = nh'^ /v'^, p g]0, l/{d + 4)[, and M > 1/ p. On the one hand, the condition 
Vnh*n ~^ implies that, for n large enough. 



exp(— 7ti;„/2) < exp 



*(d+4) 



On the other hand, the condition nh^ /[v^ log(l//i5!j)]— > 00 implies that, for n large enough, nK^^ /v^ > 
2Mlog(l//i*)/7, and thus 

exp(-7^i;„/2) < h*J' . 



It follows that 



exp(-7w„/2) < 



exp 



(_^„i-(rf+4)P/2) if hi > n-P 



n 



-Mp 



if /i* < n-P, 



and thus X^n ^^P(~7^n/2) < The almost sure parts of our results then follow from the appli- 
cation of Proposition ^ 

5.2 Proof of Theorem [T] 

Set 5 > and r/ g]0, 1[. On the one hand, we have 



< 



< 



Vn\fn{x) - f{x)\ > 5\J fn{x)K and 



Vn 
fnix) 



> 



1 



vM:ix)-fix)\> 



S\/f{x)K 



+ : 



fix) l + ri_ 

fix) - fnix) > 



+ p 

Vfix) 
1 + V 



fnix) ^ 1 



fix) 1 + 1] 
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Now, Theorem 4 in Mokkadem, Pelletier and Worms (2005) ensures that 

,,2 



hm — ^log] 
1— »oo n/i*" 



Vn\rn{x)-f{x)\ > 



2(1+7?)^ 



and, since v'^h'^/h*^ — > oo, the application of Corollary 1 in Mokkadem, Pelletier and Worms (2005) 
gives 

,,2 



lim sup " , log 



fix) - Ux) > 



Vfix) 



l + r] 



< lim sup 



n^oo 
-OO. 



""n 



1 



log] 



\f{x)-U{x)\ > 



vfix) 



l + T] 



We thus deduce that 



lim sup ^ log P /(x) 

n—>oo IT'lT'n \ 



On the other hand, we note that 
P (fix) 



f:ix)-5^M^-,f:ix) + 5^lI^ 



< 



2(1 + 7?)- 



(18) 



f*ix)-5^I^;f:ix)+6^I^ 



> 



> 



> 



> 



Vn\fnix)-fix)\>6./m^yl^ 



and 



' fnjx) 

fix) 



vn\f:ix) - fix)\ > 6^il + v)fix)K and < VT+Tj 



vn\f*ix) - fix)\ > 5^il + ri)fix)K 



VnWXx) - fix)\ > 5^il + rj)fix)K 



fix) 

P[/„(x) > (l + ??)/(x)] 

P[|/„(X)-/(X)| >7?/(x)] 



and the application of Corollary 1 and Theorem 4 in Mokkadem, Pelletier and Worms (2005) leads 
to 



hminf-^logP /(x)0 



> 



-<52(l+7?) 



(19) 



Since r/ can be taken arbitrarily close to zero. Theorem ^ is a straightforward consequence of H18() 
and (Ull). 

5.3 Proof of Theorems [H H and H 

The proof of Theorems [21 El and will require the application of Lemmas ^ and |21 below. We first 
state these Lemmas, whose proof is postponed in the appendix (see Section l^?T|) . Then, we prove 
Theorems 111131 and [21 in Sections 15.3.11 1^3?^ and ESISl respectively. 

Let Cn be a sequence of compact sets of R'^ and set Wn = sup{||x||, x G C„,}. Moreover, set 
i G]0, 1[, C > 1, and 



Un = {x e Cn, fnix) > €„} , 

Wn = {x(^ C„, fnix) < e„} , 

UniO = {xe Cn, fix) > ee„} , 

^-^(0 = {xe Cn, fix) < Cen} . 



(20) 
(21) 
(22) 
(23) 
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Lemma 1 Assume that (Al)-(A3) hold, and that (vn), {hn), {Ki)' i^n) satisfy il!^) . Moreover, 
assume that {wn) fulfills the condition 



vllogWn „ 
lim — -T — = 0. 

n-+oo nn„ 



(24) 



Then, for any 5 > 0, 

limsup— ^logl 



Vnlfnjx) - fix)\ ff-,^n 

sup ==== > and mi fn[x) > 



5^ 

< . 

2 



Lemma 2 Assume that (A1)-(A3) hold, and that {vn), {hn), {Ki), i^n) and {wn) satisfy I113\) and 
For any 5 > 0, 



1™ sup log 

n—>oo 



5.3.1 Proof of Theorem H 

To prove Theorem 0] we first estabhsh the upper bound 



hmsup ^ logP ( 3x G M", f{x) 



and then prove the lower bound 



liminf logP 3x G M'^, /(x) 



„ Tn(x)n \ Tn(x)K 



„ Tn(x)K \/Tn(x)K 



<-y, (25) 



>-f (26) 



Throughout the proof, we set C„ = |x G K"^, ||x|| < en^^'^j (we thus have Wn = f-n^^'^) 
Proof of the upper bound (|25p We have 



3x G M'^, f{x) 

Vn\f:{x)-f{x)\ 



„ Tn{x)K 

mx)-s ' ; /:(x)+5 



r„(a;)K 



sup 

x-ec„ 



< 



Tn{x)K 
Vn\f*ix)-fix)\ 



> 6 



> 6 



+ : 



+ : 



sup ""'^■■W-^WI > 5 

Vn\f*{x)-f(.x)\ ' 

sup > o 



+ p 



sup > ^ 



15 



< 



+ 



Vn\fnix) - f{x)\ 



sup 



> 6 



+ : 



+ : 



VFnn[i^„(C)]V0 



+ : 



< 



sup > . 

- > s and inf > 



+ P 



+ P sup 



+ : 



so that 



lim sup log P ( 3x G R"', /(x) 



„ T„(x)k \/Tn(x)K 



V 

< max < lim sup — 



sup ^"l/n(^) > s and inf /„(x) > 

.i:et/„{C) V fn{x)K xec/„(0 



2 2 

The application of Lemma ^ ensures that 



.(27) 



lim sup log 

ra— >oo iLiL„ 



^n|/* (^) ^ ^ .^^ ^^^^^ ^ Q 



< 4 p«) 



and the one of Lemma [21 gives 



limsup— — rlogl 



< -5M 1 



(29) 



The proof of the following upper bound is quite technical, and is postponed in the appendix 
(see Section ESI) . 



V 

limsup— ^ log] 



-oo. 



(30) 



Since 



= P [3x0 G C'n, /„ (xo) > e„ and / (xo) < Ce„" 

< P [3x0 G C„, /„(xo) -/(xo) > (l-e)en] 
1 



< 



sup |/„(x)-/(x)| > (1-0 
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we get, by application of Theorem 5 in Mokkadem, Pelletier and Worms (2005), 

,,2 



n— >oo 



limSUp logP Un n [Unm' / 

1 



< lim sup 



n—>oo 
-OO. 



n 



log] 



-sup|/„(x)-/(x)|>(l-0 



Similarly, since 



< 
< 



[ 3x0 G C*™, /n. (a:o) < e™ and / (xq) > C^n ! 
[ 3x0 G C*™, / (a;o) - fn {xq) > (C - l)en ] 

- sup |/,(x)-/(x)| > (C-1) 



the application of Theorem 5 in Mokkadem, Pelletier and Worms (2005) gives 



(31) 



lim sup log V Wnr\ [WniOT + 



2 2;^d 

< lim sup ^ 

= — OO. 



log] 



1 sup |/„(x)-/(x)| >(C-1) 



The combination of ^^-^^ leads to 



limsup— ^logP 3xG]R'^, /(x) 



^Tn(x)K \ Tn(x)K 



Since this last upper bound holds for any C > li the upper bound (|25|) follows. 



(32) 



Proof of the lower bound (|26p Set xq G n„C„ such that /(xq) / 0, and set rj g]0, 1[. Moreover, 
let n be large enough so that /(xq) > en/(l — f?)- We then have: 

^^n \fn{xo) - f{xo)\ > fn{xo)K and fn{xo)>il-v)f{xo) 
_ ^^n |/n(2;o) - /(2;o)| 



Vfnixo)^ 
Vnlfnixo)- f{xo)\ 



sup 



sup 

x€Cn 



Vfn{xo)l^ 
Vn\f*{x)-f{x)\ 



> 6 and fn{xo) > e„ 

> 5 and xq G f/n 
> d 



Tn{x)K 
Vn |/* (X)-/(X)| 

r„(x)K 



> 5. 



It follows that 
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> 
> 



iUxo) < (l-7?)/(xo)] 

[f{xo) - fn{xo) > r]f{xo) \ 



Since the application of Corollary 1 in Mokkadem, Pelletier and Worms (2005) ensures that 



n— +00 

the application of Theorem ^ leads to 
lim inf — ^ log P 

Noting that 



U 

limsup— ^logP [/(xo) - /n(2;o) > ??/(xo)] = -00, 



sup -"l^'f'-^'-^'l > * 

x&C„ \/T„(x)k 



> 



(33) 



3x G R*^, f{x) 



„ Tn(x)K \/Tn(x)K 



> 



Vn\f*ix)-f{x)\ 
sup j^=^= > 

xeCn Jfn{x)K 



the lower bound (|26() follows, which concludes the proof of Theorem^ 
5.3.2 Proof of Theorem El 

Set Cn = C for all n, set ^ g]0, 1[, C > 1, and let Wn, f/n(0> and Wn{C) be defined according 
to (HOI), (mj, and (I2S1) respectively. 

Upper bound Following the proof of ()27|1. we have: 



lim sup — ^ log P ( 3x G C, /(x) 



„ Tn(x)K \/Tn(x)K 

f*ix)-6^L^^; f*{x)+5" 



v„ 



< max < lim sup — — 



sup ^"l/n(^) > s and inf /,(x) > O 



00 nh*/ [xeUniO VJJxJk 
2 



lim sup 



f/nn[c/,(e)]V0 ; lim sup 



lim sup 



Moreover, following the proof of (|31|) and (|32|) . we get 

lim sup ^ log P [ Un n [f/„(0]' / 

lim sup ^ log p [vF„n[Ty„(c)]V0 



-00, 



-00. 
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It thus follows from the application of Lemmas ^ and [21 that 
limsup — ^ logP \3xeC, f{x) ^ 



ax) - 6^^^ ■ + 5^L^^ 



Since this last upper bound holds for any ^ > 1, it follows that 
limsup— ^ log P I 3x e C, /(x) 



„ Tn{x)K \ Tn(x)n 

f*{x) - d^L^^ ; f*{x) + 5^LJ±^ 



< 



Lower bound Following the proof of we obtain 

liminf^logP|3xGC, /(x) /^(x) 
which concludes the proof of Theorem |3J 



(5-!^ ; + (5- 



> 



' 2 ^ 



5.3.3 Proof of Theorem 

Upper bound Let (e„) be a sequence satisfying (fT^ (the existence of such a sequence is obvious 
in view of dJ). Moreover, set Cn = C for all n, set ^ g]0, 1[, and let Un{(,) be defined according 
to (EH). We note that 



ax) - 5^^M^ f:ix) + 5^^^!^ 



< 



3x e C, fix) i 

^n|/* (x) - / (x) | ^ ^ .^^ ^^^^^ ^ p 



inf /„(x) = 



Since, under the assumptions of Theorem |21 there exists a > such that f{x) > a for all x G C, 
we have, for n large enough, Un{C) = C. It follows that 



lim sup — ^ log P 3x e C, /(x) ^ 



ax) - 5^1^ ; ax) +5^1^ 



< max < limsup "^ I 



sup -^== > and ml Jn[x) > 



lim sup 



nh. 



*d 



inf /„(x) = 



(34) 



with, by application of Corollary 2 in Mokkadem, Pelletier and Worms (2005), 

n,2 



log] 



sup |/n(x) - /(x)| > a 



lim ^ 
— oo. 



log I 



sup|/n(x) - /(x)| > a 
ccec 



The application of Lemma ^ then gives 
limsup— 1^ log P 3x G C, /(x) 



ax)-5^^I^; ax)+s^^^^ 



< 
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Lower bound Set xq £ C; since /(xq) 7^ 0, we clearly have, by application of Theorem^ 



liminf-^logP ( 3x G C, f(x) ^ 



> liminf-^logP /(xo) 



fn[XO) - ; fn{xo) + 6 



> 



which concludes the proof of Theorem |21 
5.4 Proof of Corollaries [T] and [2] 

Set H = C in the framework of Corollary ^ and H = M."^ in the framework of Corollary [5J Let 6 
and 9n satisfy 

f{9) = supf{x) and /„(6'„) = sup 
and let r„ be the truncating function defined as T„(x) = max{/„(x); e„/(0)} for all x £ H. 



Upper bound We first prove that 



limsup— ^log] 

n— >oo ntl„ 



3x G ^;„|/:(x) - f{x)\ > 5dTn{x)n 



< 



(35) 



Set 7/ > 0; since 



1 + 7] 



Vx G c, r„(x) > 



Jk(x) 
1 + r/ 



we have 



3xGi/, t;n|/:(x)-/(x)| > 5JTn(x)K 



< 



< 



3x G H, Vn\f:{x) - f{x)\ > 5jTn{x)K and fn{e) > 



m_ 

l + T] 



m_ 

l + T] 



3x G H, Vn\f;Xx) - f{x)\ > 



dyTnix)K 



+ : 



f{e) - UO) > 



rif{0) 
1 + V 



The application of Theorem |31 (respectively Theorem Q in the case H = C (respectively H = R'^) 
ensures that 



lim sup , log 

n^oo nhtr 



3x G H, Vn\fn{x)- f{x)\ > 



5\jTn{x)K 



< 



^2 



2(1+7?) 



and the application of Corollary 1 in Mokkadem, Pelletier and Worms (2005) gives 



lim sup — 7^ log I 

n^oo nil 



fie) - ue) > 



1 + 7? 



< lim sup 

= — OO. 



2 

^n"'n 



1 



77, 



hi 



log] 



f{e) - ue) > 



vfje) 

1 + 7/ 
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Thus, we get 



limsup— ^logl 



3x G H, VnlKix) - f{x)\ > 6jTn{x)K 



< 



2(1 + 7/)' 

and, since rj can be chosen arbitrarily close to zero, the proof of the upper bound H35|) is completed. 



Lower bound We now prove the lower bound 



lim inf " , log ] 



3xeH, Vn\f:{x)- f{x)\ > 6jTn{x)K 



> 



(36) 



Set T] > 0; since 



fniOn) < (1 + r])f{e) Vx G C, T„(x) < (1 + r])fnix), 



we have 



3xeH, Vn\fn{x) - f{x)\ > 6jTn{x)K 



> 



> 



> 



3xeH, vn\f:{x)-f{x)\ > 6^ {1 + r])Tnix)K and /„(e„) < (1 + r?)/(e) 

F[fn{en)-f{e)>r]f{e) 



3xGH, vn\f:ix)- f{x)\ > 5J{l + ri)Tn{x)K 



3x€H, vn\f*ix)- f{x)\ > 5J{l + r])Tn{x)K 



SUp|/„(x)-/(x)| >7?/(0) 



The application of Theorem (respectively Theorem Q in the case H = C (respectively H = W^) 
ensures that 



hm inf — — 

n->oo nhi} 



log] 



3xeH, vn\f:ix)- f{x)\ > 6J{l+ri)Tn{x)K 



> 



^2(1+ 7?) 



and the application of Corollary 2 in Mokkadem, Pelletier and Worms (2005) ensures that 

„2 



V 

lim sup — ^ log ] 



snv\Ux)-f{x)\>vf{9) 
xeH 



2ud 



1 



vih 



h*J nhi 



log I 



sup |/„(x) - /(x)| > 77/(0) 



-OO. 



Thus, it follows that 



lim inf ■ 



n^oo nh: 



*d 



log] 



3xeH, vn\f:{x)- f{x)\ > 6JT„{x)k 



> 



and, since can be chosen arbitrarily close to zero, the lower bound (|36|1 follows. 
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6 Appendix 

6.1 Proof of Lemmas [T] and [2] 

The proof of Lemmas ^ and [21 requires the two following preliminary lemmas. 
Lemma 3 Under Assumptions (A1)-(A3), we have 

' Vn\f:{x) - f{x)\ 



lim sup 

n^oo 



sup log ] 



> 6 



< 



2 ' 



Lemma 4 Under Assumptions (Al)-(A3), we have 



lim sup ■ 



n— >oo 



sup log I 



Vn\f*{x)-f{x)\ 



> 5 



< 



We first prove Lemmas and |1] in Subsection 16.1.11 and then establish Lemmas ^ and |21 in 
Subsection 16.1.21 



6.1.1 Proof of Lemmas IHl and |1] 

Set 



Un{x) 

£ 



and, for any n G R, 



An,x(li) 



. ^ in the framework of Lemma |31 

/ in the framework of Lemma |1] 

UniO in the framework of Lemma El 

Wn{C) in the framework of Lemma jll 



nh* 



exp^u[/:(x)-/(x)] 



To study the asymptotics of sup^-g^-P [vnUn{x)\f*{x) — f{x)\ > 5^], we first note that, by Cheby- 
shev's inequality, we have 



and thus 



[VnUnix)[rjx)-fix)]>6''] 



nh. 



exp ^:^unix)[f*{x) - fix)] > exp 



< exp 

< exp 



nh*'^ 



n ^2 



exp 



nh 



*d 



V„ 



-Un{x)[f*ix) - fix)] 



exp 



nh*'^ 

-^KA'^nix)) 



— ^logsupP[?;„n„(x)[/:(x) -/(x)] > 5^] < -J^ + sup A„,^i 
nn'^ x<^e x&e 



Unix)). 



(37) 
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In the same way, we prove that 



log sup P [ VnUn {x) [/(x) 



(38) 



Let us set e G {—1, +1} and let us at first assume that 



Kf{x) + Rn,x{eun{x)) with lim supi?ri,2,.(e'u„(2;)) = 0. (39) 



• In the framework of Lemma |21 (|39() means that 

An^^{eun{x)) = — + Rn,x{eun{x)) With lim sup Rn,x{eun{x)) = 0, 

and Lemma |S1 is thus a straightforward consequence of (|57j) and (|55|) . 

• In the framework of Lemma El (|39|) can be rewritten as 



An,xieun{x)) = - — fix)+Rn,x{eUnix)) with lim sup Rn,x{eUn{x)) = 0, 



2e 



X&WniO 



and, since sup2.gp^/^(^) f{x)/en < C) Lemma|3]is also given by 1)37^ and (jSHJ- 
It remains to prove H39|l . Let us first note that 



An ,x 

(en„(x)) 



-VneUn(,x)f{x) + log E 

-VneUn{x)f{x) + T^logl 

fly. 



exp v^^eUn{x)^K 



X- Xi 



exp < t>„ ^eUn{x)K 



h* 

x-Xi 
hi 



By Taylor formula for the function log, there exists c„ between 1 and E exp ^en„(x)i^ {—f^^ | 
such that 



A„,x(en„(x)) 
with 



-Wneu„(x)/(x) + ^E 



exp < v,^ ^eUn{x)K 



R^^l{eun{x)) 

We rewrite An,x{eUn{x)) as 
An,x(eu„(x)) 



E 



exp < v„ "'^eu„(a;)ii' 



x-Xi 

h* 
""n 



1 



i?«.(eu„(x)) 



(40) 



-VneUn{x)f{x) + TTl 1 exp 



v^^eUn{x)K 



x-y 



ll/(y)dy-ii«(en„(x)) 



VneUn{x)f{x) + I (cxp v^^ eUn{x)K {z) — 1) /(x — /iJi-z) — R^^\{eun{x)) 

.had \ I J / ' 



vneunix)f{x)+vl [ I y-' eUnix) K (z) + ""^^l^^ ] fix - Kz) 



dz 



- R^^heunix)) + R^^UeUn{x)) 
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with 



Vn ui{x)\K{z)\' 



6 



exp 



v,^^Un{x)\K{z)\ f{x-h*^z)dz 



< 



6 



, exp 



v~\n{x)\\K\\J / \Kiz)\^dz. 



It follows that 

A„,x(eu„(x)) 



VnCUnix) / K(z) [/(x) - f{x - /l* z)] + 

-4'l(ewn(x))+i?(fi(eu„(x)) 



n2(x) 



K^{z)fix-hlz) dz 



and, setting 



i?^^^(e'u„(x)) = v„eun{x) J ^ K{z) [f{x) - f{x - h^z)] dz, 

we obtain 

An 

= <^ f K\z) [f{x - Kz) - fix)] dz + !^MM^ _ i?« (eu.(x)) 

+ RnU^Unix)) - R^^lieUnix)) 

= '"'^'^y^''^'' - R^nUeUnix)) + 41.(e^n(x)) - R^Si^Unix)) + (en„ (x) ) 



where 



To conclude the proof of Lemmas El and 01 it remains to show that 

lim sup (eM„(x)) = for iG {!,..., 4}. 

Let c and c' denote generic positive constants that may vary from line to line. We shall use 
times the fact that 



supun^x) < 



To study Rn}c{eUn{x)) defined in (|in|) . we first note that 



exp 



\ v^^eUn{x)K 



X-X^ 



> exp 



{-^;-^u„(x)||i^||oo} 



so that 



Moreover, since 



\ < exp |2i;„^M„(x)||i^||oo} • 



exp |i;„ ^eUnix)K (—f^^ } 



< E 
< 



f„^en„(x)A' 



k 

x-Xi 
h* 



exp 



Vn^eUn{x)K 



x-Xi 

h* 
""n 



hl^v-'u^{x)\\fU exp {v-^Un{x)\\KU} / jK{z)\ dz, 
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we obtain 



sup 



i?«(en„(x))| < sup/i:'^^exp{4z;-in„(x)||i^|U}||/||L(^J^(^)|d^ 



h*n ( C 
< c— exp — 



since /i* /e„ ^ and Vn^ff^-^ oo. 



It follows from (jni that 



sup|i?i^i(en„(x))| < — ^ exp - ^ 



Vn^r 



since Vn^^"^^ oo. 



• To upper bound defined in (gH), we use a Taylor expansion and Assumptions (A1)-(A3) to 
obtain 



sup 



K{z) [fix)- fix- Kz)] dz 
from which we deduce that 



< h*^ sup \\D'^f{x)\\ f \\zfK{z)dz, 



sup|i?g)^(eu„(x))| < 



since ^ ^ 0. 



Similarly, for Rn)c defined in (|43|) . we note that 



sup 

x&£ 



K\z) [fix)- fix- Kz)] dz 



<h*jK[[^ sup ||V/(x)|| / \\z[[Kiz)dz 



x& 



SO that 



Snp\RnU^Un{x))[ < 

x&e 



since 



h* 



0, 



which concludes the proof of Lemmas IHl and 01 
6.1.2 Proof of Lemmas H and 121 

In view of Assumption (A2), there exists (5 and ||i^||_f/ such that 

[Kix)-Kiy)[ < [[K[[h\\x - y[[^ Vx,y E R"^. 
Set b = sup^gRd [[Vfix)[[, 5 > 0, p £]0,6[, and 



R„ 



phn VgenK 

^2[2^/d]V(6+ ||K||h) 
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Let m be the integer satisfying Wn/Rn < m < 1 + Wn/Rn, and set N'{n) = m'^. The ball 
Dn = G K*^, ||x|| < w„| can be covered by N'(n) cubes with lenght side 2i?„ (note that Un{£,), 

WniC), and Cn are subsets of We denote by Bn\ i = 1,. . . ,N{n) {N{n) < N'{n)), the cubes 
that intersect ?7„(^), and by Bn\ i = 1, . . . ,N{n) (iV(n) < N'{n)), the cubes that intersect Wn(C)- 
Moreover, for each z G {1, . . . , N{n)}, we choose Xn^ G Bn^ n Un{C), and for each i G {1, . . . , iV(n)}, 
we choose xi'^ G bH'^ n W„(C). 



To prove Lemmas we first note that 

Vn \fni^) - f{x)\ 



sup 



> 6 



N{n) 

< El 

i=l 



< A^(n) max 

l<i<N{n) 



Now, for any i G {1, . . . , A^(n)} and for any x G -Bf"'* Pi Un{C), we write 



vn\f*{x)-f{x)\ 



sup ^^^^^ 



> 5 



\/fix)K 



Vf{x)i^ 



+ 



Vf{x)K 



+ 



On the one hand, since K is Holder continuous and since x £ B, 



(n) 



Vf{x)K 



< 



Vn\\K\\H 



X — X. 



' \\x — X 

in) P 



Vf{x)i^ 
^"^11 < 2VdRn, we get 



Vn\\K\\H[2VdRn]'' 



On the other hand, we have 







< P. 




- 2 






(n) 
X — X • 


- < 





and, since /? < 1 and Rn ^ 0, we obtain, for n large enough 

f{x'r^)-f{x) 



Vnb 


(n) 

X — x] 


- < 





Vfix)K 



< 



VnbR^ 



< P. 



P 
2' 

We deduce that, for all n sufficiently large, Vi G {1, . . . , N{n)}, Vx G B^^^ n Un{^), 



Vn\f*{x)-f{x)\ ^ 



^/f{x)K 



rn{xt^)-f{xt^) 
yJf{x)K, 
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< 



1 + 



< 1 1 + 



7R ~ 



/n(^r)-/(^r) 



< W1 + 



W4 ^ 



+ /0 



+ p 



We can then deduce that, for n large enough 

^n|/*(x)-/(x)| 



+p- 



sup 



> 5 



< N(n) max ] 

l<i<N{n) 



< N{n) sup ] 



> 



y7(^ - ^/TT^ 



Applying Lemma 01 we obtain 



1™ ^ 



'^'^P Tjt^ ^ 



< lim sup 



j vllog N{n) \ jd-p) 



ra— >oo I 



< lim sup 



2(1 + p) 

P log(tf„) - {d + P) log hi - i^^l^ + log Vn 



js - P? 

2(1 + p) 



< (since ^ 0, ""^"g;- ^ 0, 



2(1 + P) V 



nh* 



and - o' 



This last upper bound holding for any p g]0, it follows that 

„,2 



hm sup — ^ log ] 



To conclude the proof of Lemma ^ let us now set > 0, and note that 

^n|/*(x)-/(x)| 



J2 

< . 

2 



(44) 



sup 



< 



fix 



> S and inf /n(x) > 



„„^ > l + ?7 and inf /„(x) > 



sup 



+ p 



t>„|/;:(x)-/(x)| ^ ^ 

XGUniO \fT(x)K ~ \/l 



< 



sup ji— > — — 



+ p 
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Since x G Un{S,) =^ f{^) ^ C^n and since v^h^c^/h^ — > oo, we have, by application of Xheorem 5 
in Mokkadem, Pelletier and Worms (2005), 



limsup 

n— >oo nri„ 



fix) - fn{x) V 

sup j^-^ > -r~ 



1 



< limsup^^ipp. — ^ 
= — oo. 



- sup > 



Now, in view of (|1H). we deduce that 



1™ sup log I 



sup TTT^ - ^ 

x€U„{0 Vfn{x)K 



< 



2(1 + 7])- 



and, since this last upper bound holds for all i] > 0, Lemmas follows. 



To prove Lemma |2 we proceed exactly in the same way as for establihing ()44() : we first note 
that 



sup ^-\fni-)-m\yS 



with, for any i G {1, . . . , N{n)}, x ^ B\ n WniC)-, and n large enough, 



< Nin) max ] 

l<i<N(n) 

(n) 



"..IfiC^O^^'"'! > s 



xeB<"'nl4^„(C) 



/(in.K 



Vn\f*ix)-fix)\ ^ ^ 



/n(^)-/n(^S"^) 



+ 



+ 



fixf)-fix) 



/6r),/t 



< 



/ 6n, K 



We then deduce that 

Vn\f*nix)-fix)\ 



sup 



> 5 



+ p 



< N{n) sup ] 
xeW„(C) 



vn\f:ix)-fix)\ 



>b-p 



and, applying Lemma |3 we obtain 



lim sup " , lo; 



sup '-i/iw-/wi>, 



log iV(n) 



< hmsup ^"':":/-" (1-^ 



Since this last upper bound holds for any p > 0, Lemma |21 follows. 



6.2 Proof of dSOD 

Since > for all x G M'^, we have 

limsup-^ log 



sup ^ ^ 

^■ecs Jx^{x)k 



< limsup— ^ log 



sup "" l^"'-^^'--'! > i 

|j2:||>ui„ y^nl^ 
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Now, recall that sup||2,||gjjd |E(/*(x)) — f{x)\ = 0{h*^); in view of the condition Vnh*^ / y/e^ 
H13|) . Equation H30|) is thus a straightforward consequence of the asymptotic 



hmsup— ^logl 

n— >oo nU„ 



||a;||>ui„ \J^n^ 



To prove ()45() . we need the following technical Lemma. 

Lemma 5 Assume that (Al) and (A4) hold. For all 7 > 0, we have 



sup 

||x||>ii)„ 



^K'(^^)f{y)dy < 7/^:V 



-00. 



in 



(45) 



Proof of Lemma [5] Set 7 > 0, and write 
1 [ T^2(x-y 



— / K^{z)f{x-hlz)dz + — f K^{z)f{x-hlz)dz 

J\\z\\<Wr,./2 Cn J\\z\\>w„./2 



En J\\z\\<Wn/2 Cn J \\z\\>w„/2 

On the one hand, we note that 

llxll > and ||z|| < 1(^71/2 =^ ||x — /i* 2;|| > — /i*/2| 

=^ ||x — h^z\\ > Wn/'2, for n large enough 

f{x — h*^z) < Mf2'^w~'^ for n large enough 

(where Mf = sup^-gRd ||x||''/(x)), so that 

1 r A/f 9^ r 

sup — / K\z)f{x - hlz)dz < / K'^{z)dz 



l|a;||>Wn "'p||<'!i>n/2 Wn^n 



7 

< — for n large enough 



(since u)^e„— > cxd). 

On the other hand, we have 



sup — f K'^{z)f{x — h*^z)dz < sup 11:^1^2 — [ WzW^ K'^{z)dz 

\\x\\>Wn J\\z\\>Wn/2 \\x\\>w^ Wnen Jmd 



7 

< — for n large enough 



which concludes the proof of Lemma |SJ □ 
Let us now come back to the proof of H45|l . Set 



^n = { ) ; ||x|| > Wr 



The classes .Fn, n > 1, are contained in the class J^{K) defined by (HJ; since K satisfies the covering 
number condition H1U|) . there exist ^ > and v > such that, Ve > 0, Vn > 1, 



A^2(e||i^||oo,P,-^n) < • 
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Now, let us take U = ||i^||oo and o"^ = jh^en with 7 > 0. Since K^en — > and in view of Lemma 
ini we have, for n sufficiently large, 

a < U/2 



and 



x-Xi 
hi 



for > Wr,. 



Thus, it follows from Theorem 2.1 of Gine and Guillou (2002) that there exist two constants M 
and L depending only on A and v such that, for 



t > L I [/ log ^ + ^/i^aJ log ^ 



we have 



sup 



log 

< logM 



n r / V 



E 

i=l 
t 



MU 



K 

log + 

3/2 



E K 



X - Xi 



> t 



tU 



M[^a + Uy/log{U/a)]y ' 



(46) 



It follows from the conditions h*^/^n 0, Vn^n — > 00 and n/i* log(l//i* )] ^ 00 in ((T^ that 



lim„_^oo \/na/[UJ\og ^] = cxd, and thus, for n large enough, 



\/na + f/y log — < l^pno. 



(47) 



Now, set tn = 5nh*^ ^enK/vn- It follows from (|17|) that, for n large enough, 



U\og^ + ^<j^\og^ ^ 2^a^log^ 



< 



The conditions h^/en and n/i*'^/[-i;^ log(l//i* )] ^ cxd in ((T^ ensure then that, 
enough, 

tn> L \Ulog^ + ^/na J log ^ 



for n large 
(48) 



Since 



log] 



Vn\f*{x)-E{f*{x))\ 
.|ja;||>«i„ \/en^ 



log] 



sup 

||z||>ui„ 



n r / V 



E 

1=1 



h* 



K 



X - Xj 
h* 



>tn 



it follows from H46() . (|Tr|) and (|151) that, for n large enough, 

Vn\f*{x)-E{f*{x))\ 



log] 



sup 

||2:||>?i)„ 



> 6 



'€nK 



< logM 



MU 



log 1 + 



tnU 
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Noting that 



we obtain 



lim 



tnU 



lim 



5U 



vt. 



lim sup log 



n->oo 4:Mna'^ n^oo 4:M^Vn^/e^ 
Vn\f*{x)-E{f*ix))\ 



0, 



sup 

||x||>to„ 



> 6 



V. 



n "n 



< — lim sup ■ . , , ^r, o 



< 



6^K 



which implies ()45() by letting 7 — > 0. 
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